1/12 



FIG. 1 



MOBILE INTERNET 
ACCESS SERVICE 
PACKET NETWORK 



SPEECH - 

INTERPRETED 
SPEECH 



MOBILE INTERNET SERVICE 
GATEWAY SERVER 



AUTHENTICATION 
SERVER 



32 



ACCOUNTING 
SERVER 



33 



ACCOUNTING 
TABLE 



AUTOMATIC 
INTERPRETATION 
SERVER 
1000 

S 



20 



SENTENCE 
DICTIONARY 



SPEECH 




INPUT 




MEANS 





WORD 
DICTIONARY 



21 



COMMAND 
DICTIONARY 



SPEECH 
RECOGNITION 
MEANS 



10 



TABLE FOR 
LANGUAGE 
CONVERSION 



GRAMMAR 
TABLE 



TELEPHONE 

CIRCUIT 

BOARD 



12 



SPEECH 
SEGMENTS 
SET 



LANGUAGE 

TRANSLATION 

MEANS 



14 



CPU 



15 



MEMORY 



16 



LANGUAGE 
CLASSIFICATION 
DISPLAY MEANS 



11 



SPEECH 
GENERATION 
MEANS 



13 



SPEECH 
OUTPUT 
MEANS 



17 



SCENE 

DISPLAY 

MEANS 



22 



TABLE FOR 
KINDS OF 
LANGUAGES 



MODEL 
SENTENCE 
DISPLAY MEANS 



-A 7 



23 



SCENE 
TABLE 



19 



RECOGNITION 
CANDIDATE 
DISPLAY MEANS 



24 



MODEL 

SENTENCE 

TABLE 



2/12 



FIG. 2 



C.\J 1 


WAVE 




202— 


Ob 1 HINva 




203— 


IADAMCCC 




204— 


ION 1 




205— 


RECOGS (1 } 






RECOQPNUM (1) 






RECOGSNUM (1) 












nCV/U\JC> \Vi) 






RECOGPNUM (N) 






RECOGSNUM <N) 




206- 


- RESULT 




207- 


- SYNWAVE 




208- 


- . JCNT 




209- 


LANG 




210- 


SCENE 




211- 


^ BSENTENCE 




212- 


- CSENTENCE 




213- 


PCAND 




214- 


SCAND 




215- 


INDEX 











3/12 



FIG. 3 



FIG. 4 




CD CD CD 
CD CD CD 
CD CD (XI 
CD CD CD 

r~F| [clear] 



MENU 



2. HOROSCOPE 

3. AUTOMATIC 
INTERPRETATION 

4. STOCK QUOTATIONS 



CD CD CD 
CD CD (XI 
CD CD CD 
GDCDCD 
CD © 



-104 



4/12 



FIG. 5 



FIG. 6 



2. JAPANESE->ENGLISH 

3. JAPANESE-HMNESE 

4. JAPANESE-WENCH 



GDCDCD 
CD CD® 

CD(T)(T) 

QGDQD 

f"F~| [clear] 



• •• 
••• 



^100 



-101 




-104 



r, 





2. HOTEL 




3. RESTAURANT 




4. HOSPITAL 







— V 



□DUD CD 
CD CD CD 

QDCDCD 
CD CD CD 

[~F~] (clear) 



• •• 

• •• 



5/12 



FIG. 7 



FIG. 8 



S 
















[] tmwxt 




VS. 


— V 



QD CD CD 
CD CD CD 
CD CD CD 
GO CD CD 
CO f^) 



dD — 



-100 



-100 




QDGDCO 

CD CD CD 

QCDCD 

(Tl (clear] 



-104 



6/12 



FIG. 9 

311 312 



313 





MODEL ; 

SENTENCE 

NUMBER 


) 

SENTENCE 


TRANSLATED WORDS 






NUMBER 


1 


2 1 


















301 — 


4 


1 




I'd like to have a glass of water. 




302- 


4 


2 




Can I see the menu ? 




303- 


4 


3 




I'd like to have a cup of coffee. 




304- 


4 


4 




I'd like to have a spoon. 

















FIG. 10 



I'd like to have 
a glass of water. 




□DCDGD 
GDQDCl) 



-100 



-101 



-104 



7/12 



FIG. 11 



411 412 





USER ID 


CHARGE 








401- 


1234 


100 


402- 


1235 


0 


403- 


1236 


300 


404- 


1237 


850 









FIG. 12 





811 


812 




LANGUAGE ' 
CLASSIFICATION 
NUMBER 


i s — I 

LANGUAGE 
CLASSIFICATION 


801- 


1 


JAPANESE-KOREAN 


802- 


2 


JAPANESE^ENGLISH 


803- 


3 


JAPANESE-+CHINESE 


804- 


4 


JAPANESE-FRENCH 









8/12 



FIG. 13 



911 912 





SCENE 
NUMBER 


SCENE 


901- 


1 


AIRPORT 


902- 


2 


HOTEL 


903- 


3 


RESTAURANT 


904- 


4 


HOSPITAL 



FIG. 14 





511 

■ 5- 


512 

5 


513 




SCENE 
NUMBER 


MODEL SENTENCE 
NUMBER 


I S 1 

MODEL SENTENCE 




1 


1 


[] ItEZHttfl 










501- 


3 


1 




502- 


3 


2 




503- 


3 


3 


[] itezvtfr 


504- 


3 


4 


[] tmu\-ct 


505- 


3 


5 


[] lifcurr^ 


506- 


3 


6 


[] TT£U 











9/12 



FIG. 15 





611 


612 


613 


614 




MODEL ' 

SENTENCE 

NUMBER 


1 $~ 

SENTENCE 
NUMBER 


I s 

SENTENCE 


J 

CHARACTERISTICS 
VECTOR SEQUENCE 


601- 


1 


1 




A11.A12,- 


602- 


2 


1 




A21.A22,- 












603- 


4 


1 




A31.A32, - 


604- 


4 


2 




A41.A42,- 


605- 


4 


3 


Z-U-tfi&UWt 


A51,A52, - 


606- 


4 


4 




A61.A62, - 






! 







f/g. 76 





711 


712 


713 




I 

COMMAND 
NUMBER 


I 5 

COMMAND 


I s — 1 

CHARACTERISTICS 
VECTOR SEQUENCE 


701- 


1 




B11 f B12,- 


702- 


2 


OH 


B21.B22, - 


703- 


3 












B31.B32,- 



10/12 



FIG. 17 



SPEECH ■ 



INTERPRETED 
SPEECH 



AUTOMATIC 
INTERPRETATION 
SERVER 
1000 

^ 




MOBILE INTERNET 
ACCESS SERVICE 
PACKET NETWORK 



MOBILE INTERNET SERVICE 
GATEWAY SERVER 



1001 



AUTHENTICATION 
SERVER 



32 



ACCOUNTING 
SERVER 



33 



ACCOUNTING 
TABLE 



TELEPHONE NETWORK 



1002 



20 



SENTENCE 
DICTIONARY 



SPEECH 




INPUT 




MEANS 





WORD 
DICTIONARY 



COMMAND 
DICTIONARY 



/v/O 



SPEECH 
RECOGNITION 
MEANS 



10 



TABLE FOR 
LANGUAGE 
CONVERSION 



GRAMMAR 
TABLE 



TELEPHONE 

CIRCUIT 

BOARD 



12 



SPEECH 
SEGMENTS 
SET 



LANGUAGE 

TRANSLATION 

MEANS 



11 



SPEECH 
GENERATION 
MEANS 



13 



SPEECH 
OUTPUT 
MEANS 



14 



CPU 



15 



MEMORY 



16 



LANGUAGE 
CLASSIFICATION 
DISPLAY MEANS 



17 



SCENE 

DISPLAY 

MEANS 



22 



TABLE FOR 
KINDS OF 
LANGUAGES 



MODEL 
SENTENCE 
DISPLAY MEANS 



23 



SCENE 
TABLE 



19 



RECOGNITION 
CANDIDATE 
DISPLAY MEANS 



24 



MODEL 

SENTENCE 

TABLE 



11/12 

FIG. 18 ( START ) 

\ . , ^s1 00 

THE USER TURNS THE POWER OF THE TERMINAL 1 ON 
AND CONNECTS IT WITH THE GATEWAY SERVER 



X 



THE AUTHENTICATION SERVER 31 CONFIRMS THE USER AS 
A REGISTERED ONE AND SENDS THE USER ID TO THE 
ACCOUNTING SERVER 32 



s101 



THE GATEWAY SERVER 3 DISPLAYS 101 THE MENU OF 
THE SERVICE ON THE DISPLAY OF THE TERMINAL 



I 



T 



I 



THE USER SELECTS THE LANGUAGE CLASSIFICATION BY 
PRESSING OF THE UP-DOWN BUTTON AND DECIDES IT BY 
PRESSING THE DECISION BUTTON 



THE SCENE DISPLAY MEANS 17 IS MOTIVATED AND IT 
DISPLAYS THE SCENE ON THE DISPLAY 101 



T 



THE USER SELECTS THE SCENE BY PRESSING OF THE 
UP-DOWN BUTTON AND DECIDES IT BY PRESSING THE 
DECISION BUTTON 



THE MODEL SENTENCE DISPLAY MEANS 18 IS MOTIVATED 
AND IT DISPLAYS THE MODEL SENTENCES ON THE 
DISPLAY 101 



THE ACCOUNTING SERVER 32 RESETS THE CHARGE $ 
COLUMNS CORRESPONDING TO THE USER ID OF THE 
ACCOUNTING TABLE 33 



S102 



THE USER SELECTS THE AUTOMATIC INTERPRETATION $ 
SERVICE BY PRESSING OF THE UP-DOWN BUTTON AND 
DECIDES IT BY PRESSING THE DECISION BUTTON 



j^s103 
S104 



THE LANGUAGE CLASSIFICATION DISPLAY MEANS 16 IS $ 
MOTIVATED AND IT DISPLAYS THE LANGUAGE 
CLASSIFICATION ON THE DISPLAY 101 



s105 



r s106 

^s107 
s108 



s 



THE USER INPUTS HIS SENTENCE SPEECH WATCHING ^ 
MODEL SENTENCES ON THE DISPLAY 



^s109 
S110 



12/12 



FIG. 19 



THE SPEECH INPUT MEANS 5 STORES INPUT SPEECH IN 
WAVE 201 



I 



s1 1 1 



THE SPEECH RECOGNITION MEANS 6 IS MOTIVATED AND IT 
COMPARES THE CHARACTERISTICS VECTOR SEQUENCE OF 
THE SPEECH IN WAVE 201 WITH THE CHARACTERISTICS 
VECTOR SEQUENCE OF EACH SENTENCE WITHIN DISPLAYED 
SENTENCES ON THE DISPLAY 101 AND DISPLAYS M 
CHARACTER STRINGS AS RECOGNITION RESULTS IN 
HIGHER ORDER OF MATCHING SCORE ON THE DISPLAY 101 
OF THE TERMINAL 1 (M=4) 



^s112 



± 



THE USER SELECTS THE CORRECT SENTENCE IN THE 
RECOGNIZED RESULTS BY PRESSING THE UP-DOWN 
BUTTON AND DECIDES IT BY PRESSING THE DECISION 
BUTTON 



^s114 



THE DECIDED CHARACTER STRING IS STORED IN 
RESULT 203 



X 



S115 



THE LANGUAGE TRANSLATION MEANS 7 IS MOTIVATED ANDk s116 
IT CONVERTS THE CONTENTS OF JAPANESE 203 INTO P 
ENGLISH BY USING THE TABLE FOR LANGUAGE 
CONVERSION AND STORES IT IN 



T 



THE SPEECH GENERATION MEANS 12 IS MOTIVATED AND 
IT CONVERTS THE CONTENTS OF ENGLISH 206 INTO 
SYNTHESIZED SPEECH AND SENDS IT TO THE TERMINAL 1 
AND STORES IT IN THE MEMORY OF THE TERMINAL 



^s117 



I 



THE PRESCRIBED CHARGE PER 1 INTERPRETATION IS < s118 
ADDED TO THE ACCOUNTING COLUMN CORRESPONDING TO 
THE USER ID IN THE USER ID COLUMN OF THE 
ACCOUNTING TABLE IN THE ACCOUNTING SERVER 



I— s11g 



THE USER PRESSES THE INTERPRETED SPEECH OUTPUT $ 
BUTTON OF THE TERMINAL 1 AND THE INTERPRETED 
SPEECH IS OUTPUT FROM THE SPEAKER 100 OF IT 

( END ) 



